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The  Outline 


1.  Elastic  Networks  (  flW  CfO- 

2.  Electrostatically  Driven  Elastic  Networks 

3.  Piezoelectrically  Driven  Elastica 

4.  Actuators 

5.  Models  for  Hysteresis  ' 

6.  Nonlinear  Oscillatorv  Effects 


Elastic  Networks 


Bending  beam  equation  relates  the 

curvature  and  the  moment 
K  -  M. 

K  ~  EI 

E  =  Young’s  modulus,  I  =  second  moment 


of  area. 


Structures  tend  to  be  complex  with  many 
loops  and  few  (if  any)  “pin  joints” . 
Flexures  are  easier  to  fabricate  than 
bearings.  (Later  discussion  of  valves, 
arrays  of  mirrors,  ... 


Interpreting  Some  Basic  Physics 


Stored  energy  in  terms  of  capacitance  and 
voltage  or  charge:  E  =  |Ce2  =  ^ q 2 
C  =  Ae/d  for  parallel  plate  capacitor. 


force 

voltage 
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displacement 


voltage=e 


displacement=x 


charge=q 


force=f 


Linearizing  about  (eo,#o) 


C(x0) 
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Electrostatic  Motors 


One  way  in  which  electrostatic  and  elastic 
effects  have  been  combined  in  devices  is  in 
the  design  of  tuning  forks.  The  diagram 
below  illustrates  a  sample  design  for  an 
electrically  driven  vibrating  element. 


The  force  on  the  vibrating  element  can  be 

determined  from  the  derivative  of  the 
capacitance 


Electrostrictive  Stacks 


Uses  high  permittivity  dielectric  thus 
yielding  large  values  for  C  and  rj^ 


Inserting  insulating  layers  permits  the 
use  of  lower  voltages  for  reasonable 
strains. 


Illustrating  the  possibility  of  multiple 
equilibria  and  the  basis  of  hysteresis. 


Electric  and  Elastic  Effects 

The  plates  of  the  capacitor  will  be  held  in 
position  by  a  system  with  mechanical 
compliance. 


Electrostatic  force  falls  off  with  increasing 
x.  Note  the  possibility  of  multiple 
equilibria  even  if  the  elastic  law  is  linear. 
Some  will  be  unstable. 


Introducing  Dynamics 


Lagrangian  depends  on  electrostatic 
energy  V  and  elastic  energy  E 
L(x,  x )  =  —  ~C(x)e2  —  E(x) 


“  i  OV  i 

mx  +  -^  + 
ftC(x)e  =  i 


dE 

dx 
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Highly  nonlinear-equilibrium  comes 
from  electrostatic-elastic  balance. 
Electrical  termination  helps  determine 
mechanical  compliance. 


The  Small  Strain  Problem 


i  For  common  piezoelectric  materials  the 
i  strain  is  small,  Al/l  «  10-4 
]  The  effect  can  be  amplified  with  bilayers 


Assume  that  the  layer  on  the  left  expands 
while  the  layer  on  the  right  contracts  in 
equal  amount,.  Then  the  curvature  and 
displacement  are 

curvature  =  displacement  =  ^ 


Piezoelectric  Motor  a 

A  correctly  phased  set  of  sinusoidal  voltagt 
applied  to  a  set  of  benders  produces  a 
change  in  the  geometry  of  a  solid  in  the 
form  of  a  traveling  wave. 

exaggerated  view  of  surface  shape 


peizoelectric  elements 

The  traveling  wave  can  be  coupled  to  a 
moving  element  to  produce  linear  motion. 


moving  element-"'' 


peizoelectric  elements 


This  is  the  basis  for  “ultrasonic”  motors. 


Piezoelectric  effects  ) 

(  x  /tt-A  tkt  ^J»rri  ) 

An  applied  voltage  produces  a  change  in 
the  geometry  of  a  solid.  If  the  solid  is  a 
polarized  sample  of  a  material  such  as 
barium  titanate  the  change  is  significant 
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di3  c/33  and  are  material  properties. 
9  is  the  shear  angle  in  radians 


Poling  Piezoelectrics 


Many  piezoelectric  materials  acquire  their 
special  properties  from  the  presence  of 
internal  electric  dipoles  whose  existence  is 
characteristic  of  ferroelectric  materials. 
Ferroelectric  materials,  like  feromagnetic 
materials,  are  most  useful  when  prepared 
so  as  to  be  in  particular  equilibrium  states. 
In  the  case  of  ferroelectrics  the  preparation 
process  produces  an  internal  polarization 
and  is  achieved  by  application  of  a 
strong  electric  field  during  manufacture. 
The  effect  of  an  electric  field  applied 
subsequently  will  depend  on  the  orientatior 
of  the  applied  field,  relative  to  the 
orientation  of  the  polarization. 


Hysteresis  and  Multiple  Equilibria 

Hysteresis  is  essential  to  the  operation  of 
ferromagnetic,  ceramic  piezoelectrics  and 
phase  change  materials. 


Hysteresis  is  both  a  static  and  a  dynamic 
phenomenon. 

A  simple  dynamic  model  for  hysteresis 
takes  the  form 

H  =  H2N{u)  -  2 HN(u)H  +  N(u)H 2 


If  H  is  n  by  n  and  symmetric  and  N 
is  diagonal  then  the  system  can  have 
as  many  as  n!  equilibrium  states.  Typically 
the  output  variable  would  take  the  form 


y(t)  =  tr  (. H(t)M ) 
with  M  constant. 

Aaj kocU 


i ,  r  h,  [  «,  ^  j  1 1 

■jUi 


4A  -OA  -OJ  0  ai  0.4  04  0« 


Actuation  with  Phase  Change 

Certain  materials  such  as  the  nickel- 
titanium  alloy  Nitinol.  change  their  interna 
structure  at  a  critical  temperature.  This 
phase  change  is  accompanied  by  a  change 
in  the  geometry.  If  the  sample  is  in  the 
form  of  a  wire  there  may  be  as  much  as  a 
10%  change  in  its  length.  A  prototype 
temperature-stress-length  diagram  and 
block  diagram  suggestive  of  the  use  of  heat 
flow  and  stress  as  inputs,  is  shown. 


length 


Nitinol  has  been  incorporated  in  a  variety 
of  devices  in  which  the  temperature  change 
is  produced  by  an  electric  current. 


The  Concept  of  Rectification 

Small  strain,  high  frequency  oscillations 
must  be  “rectified”  mechanically  to 
generate  rectilinear  motion.  What  forms 
do  mechanical  rectifiers  take? 

x  =  u  becomes  x  =  sin  ut 

y  =  v  becomes  y  =  cos  ut 

z  =  xv  —  yu  becomes  i  =  1 

Inchworm  kinematics  involve  clamping  and 
deformation-a  “discrete”  version  of  these 
equations. 


^  Clamps - - — 
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Electromagnets 
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Issues  on  Computer-aided  Process  Operation: 

Hybrid  Networks  for  Process  Modelling  and  Control 

Sebastiao  Feyo  de  Azevedo  and  Rui  Oliveira 

Department  of  Chemical  Engineering  /  Institute  for  Systems  and  Robotics,  Faculty  of 
Engineering,  University  of  Porto,  Rua  dos  Bragas,  4099  Porto  Codex,  Portugal,  E-mail: 
sfeyo@fe.up.pt 

Issues  concerning  the  theory  and  practice  of  computer-aided  process  operation  (CAPO)  will  be 
addressed  in  this  lecture.  In  essence,  the  topics  to  be  discussed  relate  to  new  emerging 
knowledge  engineering  techniques  and  to  how  they  can  be  used  and  integrated  in  the  so-called 
'process  industries'  for  improving  their  performance. 

The  development  of  new  or  improved  forms  of  process  operation,  be  it  a  chemical  or  a 
biochemical  process,  is  only  successfully  achieved  when  it  is  possible  to  match  the  theoretical 
innovation  with  the  technology  available  for  implementation  at  industrial  scale.  A  kind  of 
landmark  in  the  history  of  CAPO  can  be  recognised  as  having  been  reached  at  the  close  of  the 
eighties.  Nowadays,  a  large  number  of  control  systems  suppliers  offer  the  capabilities  of  the 
digital  technology,  employing  open  architecture  and  standard  operating  systems  and, 
particularly,  allowing  external  and  independent  modules  to  be  incorporated  into  the  control 
configurations.  The  flexibility  and  computational  power  are  now  available,  with  industrial 
standards,  to  implement  monitoring  and  identification  strategies,  to  develop  software  sensors,  to 
implement,  at  local  level,  new  and  more  efficient  digital  controllers  and,  at  supervisory  level, 
knowledge-based  applications.  Artificial  Neural  Networks  and  Fuzzy  Inferential  Systems  are 
today  tools  which  can  be  incorporated  into  the  available  industrial  equipment  without  hard 
computational  power  constraints. 

The  phenomenological  knowledge  available  is  usually  scarce  and  its  use  for  implementing 
supervisory  strategies  is  generally  difficult  and  too  expensive.  For  this  reason  many  decisions 
.concerning  process  operation  keep  being  made  today  on  the  basis  of  the  heuristic  knowledge  of 
plant  engineers  and  operators.  Knowledge  engineering  techniques  open  die  possibility  for 
incorporating  qualitative  information  and  information  hidden  in  process  data  records  into  the 
supervisory  system,  thus  increasing  greatly  the  spectrum  of  knowledge  available  for  improving 
process  performance. 
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This  lecture  will  focus  on  a  new  technique:  Knowledge-Based  Hybrid  Networks  for  process 
monitoring,  control  and  optimisation..  Such  Networks  are  computational  structures  which 
combine  available  classical  mathematical  models  with  knowledge-based  numeric  computation 
techniques.  The  advantage  of  such  a  methodology  in  comparison  to  the  classic 
phenomenological  model-based  approach  alone  is  that  more  knowledge  can  be  used:  i)  the 
heuristic  knowledge  of  process  engineers  and  operators  -  using  Fuzzy  Inference  Systems  -  and  ii) 
the  knowledge  hidden  in  process  data  records  -  using  Neural  computational  methods. 

The  concepts  will  be  illustrated  with  the  application  to  the  operation  of  fermentation  processes. 
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Plan  for  the  Talk 


©  Scope 

©  Progress  in  Computer-Aided  Process  Operation 

•  Technology  and  (vs.)  theory 

•  Prevailing  bottlenecks 

©  Capturing  and  representing  the  knowledge 

•  Forms  of  knowledge  and  modelling  approaches 

©  Model-based  and  Hybrid  methods  for  process 
monitoring  and  control 

©  Case-studies 

□  Software  sensors  -  mechanistic  and  hybrid  approaches 

□  Hybrid  modelling  and  process  control 

©  Some  concluding  thoughts 

•  The  Human  factor  -  investment,  knowledge  and 
industrial  structure 
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Progress  in  computer-aided  process  operation 

About  the  (old)  gap  between  theory  and  practice 


The  development  of  new  or  improved  forms  of  process 
operation  is  only  successfully  achieved  when 


It  is  possible  to  match  theoretical  innovation  with  the 
technology  available  for  implementation  at  industrial 

scale 
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Computer-Aided  Process  Operation 
Interdisciplinary  View 
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Progress  in  computer-aided  process  operation 
I  -  identification  of  areas  of  interest 

«=>  Progress  in  digital  technology  - 
O  sensors 
and 

O  control  systems 

■=>  Progress  in  theory  - 

O  in  process  modelling  and  control 
or,  wider 

O  in  process  systems  engineering 

«=>  Concern  with  the  Human  Factor,  as  a  limiting 
step  in  the  pace  of  development- 
O  new  expertise  in  the  production 
team 

O  organizational  changes  in 
Companies 
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Progress  in  computer-aided  process  operation 
II  -  process  measurements 

Sensors  and  analytical  instruments  are  the  primary 
elements  for  process  monitoring 

O  In  spite  of  the  observed  progress  in 

measurement  technology  - 

□  To  a  large  extent  the  technological 
bottleneck  is  in  process  measurements 


At  present  - 

O  indirect  measurements  are  still  required  for 
important  properties. 

Serving  as  example,  not  yet  achieved  - 

O  reliable  direct  measurement  of  crystal  size 
distribution  in  industrial  crystallisation 

or 

O  measurement  of  biomass  in  fermentation  processes 
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Progress  in  computer-aided  process  operation 
III  -  industrial  control  systems 


A  landmark  in  the  history  of  CAPO  has  been  reached  at  the 
close  of  the  eighties 

Nowadays,  control  systems  suppliers  offer  open 
architecture,  standard  operating  systems  and  employ 
standard  communications  protocols,  allowing  - 

O  programming  with  high  level  languages 
and 

O  integration  of  USER-TAILORED  applications 
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Evolution  in  Computer  Control  Systems  and 
Control  Systems  Architectures 


c 

e 


2000 

Open 
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Progress  in  computer-aided  process  operation 
IV  -  Towards  model-based  methodologies 

^  Model-based  methodologies: 

O  Re-thinking  of  concepts  on  capturing  and 
representing  process  knowledge 

O  Employing  knowledge  engineering  approaches 

O  Employing  hybrid  approaches  -  Combining 

different  forms  of  knowledge  through  some  (more 
or  less)  ‘fuzzy’  decision 

□  Mechanistic  models 

□  Empirical  models 

□  Artificial  neural  networks 

□  ..... 
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Progress  in  computer-aided  process  operation 
V  -  Process  measurement  and  control 

Process  measurements  -  Software  sensors  based  on 

□  Mechanistic  models 

□  Artificial  neural  networks 

□  Hybrid  models 

^  Process  control 

O  Significant  progress  in  conventional  control 
O  Model  Based  Process  Control  (MBPC) 

□  Model  reference  adaptive  control 

□  Model  based  (adaptive)-predictive  control 
O  Hybrid  approaches  for  process  control 

O  Real  time  knowledge  based  systems  (RTKBS) 


SFA/RO,  ISR/DEQ-FEUP,  Porto,  Portugal 


Computer-Aided  Operation  of  Chemical  and  Biochemical  Processes 


Capturing  and  representing  process  knowledge 

I  -  forms  of  knowledge 


Knowledge 


/  PhysA 
/  under-\ 

>  /  standing  \ 


/  Heuristic.  N 
Common  Sense 


Knowledge  modelling 


/Math\ 

/  modell.\ 

$ 

/Fuzzy  systemsX 
Empirical  corr. 
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Capturing  and  representing  process  knowledge 
II  -  modelling  approaches 


^  Mechanistic  (first  principles)  models 

$  =  r(§)-D5  +  F-Q(5) 


Input-output  (stochastic)  models 


A(q_1 )  y(t)  =  B(q-1)  u(t)  +  C(t)  CO(t) 


where 


q'1  y(t)  =  y(t-i) 

e.g.:  Level  control  (h)  with  Outlet  Flowrate  (Q) 


2  2 

~  ai  hk-i  hj  Qk-j 
i=i  j=i 
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Capturing  and  representing  process  knowledge 
II  -  modelling  approaches  (cont.) 


AI  models 

eg.:  Jordan  Neural-Net 


<*■  Hybrid  models  (Mechanistic  +  ANN  and/or  Fuzzy  and/or 
RTKBS) 

O  Capturing  hidden  knowledge  and  avoiding 
violation  of  first  principles 
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Bottleneck  -  lack  of  reliable  measurements 


A  topic  in  the  front  line  of  concern  is  that  of- 

O  monitoring  the  behaviour  of  internal  process  variables  which 
define  the  so-called  process  state  and  for  which  direct 
measurements  are  either  - 

□  not  available, 

□  difficult, 

□  expensive 

□  or  inaccurate 

Software  sensors  -  a  concept  to  overcome  such 
difficulties 
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Software  sensors  and  on-line  state  estimation 

I  -  general 


©  The  concept  of  'software  sensors'  is  a  major  development,  made 
possible  by  computers,  towards  the  objective  of  full  monitoring 
of  process  operation. 


©  In  general,  'software  sensors'  should  be  seen  as  a  method 
by  which  with  a  minimum  number  of  direct  measurements  we 
are  able  to  fully  describe  the  process  state  at  any  point  of 
operation. 
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Software  sensors  and  on-line  state  estimation 
II-  based  on  mechanistic  models 


(D  Often  'software  sensors'  consist  only  in  the 
manipulation  of  simple  algebraic  relationships. 

That  is  the  case  for  supersaturation  in  crystalization 
processes. 

©  In  other  instances,  the  'sensor'  requires  the  use  of  the  full 
deterministic  model. 

□  Usually  one  should  look  for  some  form  of 

transformation  which  eliminates  the  'less  accurately 
known'  terms  in  the  model. 


Invariably  these  are  'kinetic  rate'  terms 
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Software  sensors  and  on-line  state  estimation 
III-  based  on  ANN  or  Hybrid  approaches 


©  In  other  cases  ‘black-box’  approaches  are  employed. 


This  raises  major  questions  of  confidence  on  results  outside 
training  areas 

©  Hybrid  solutions  envolving  mechanistic  models  and  ANN  may 
represent  a  good  solution  for  the  applied  problem 


Capturing  hidden  knowledge  and  avoiding  violation  of  first 
principles 
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Modelling  and  Control 
of  Fermentation  Processes 

Cooperation  with 

□  University  of  Minho,  Braga,  Portugal 

n  Martin-Luther  University,  Halle-Wittenberg,  Germany 

□  CESAME,  Louvain-la-Neuve,  Belgium 

General  objectives  -  modelling  and  control  of 
biological  reactors 

□  Major  difficulties  related  with  the  ‘unpredictable’  behaviour  of 
biological  systems 

□  Significant  difficulties  when  applying  mechanistic  models  ‘only’ 

□  AI  methods  for  capturing  knowledge 

□  Looking  into  hybrid  solutions 
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Basic  concepts 

Mechanistic  model  for  fermentation  processes 


Let  us  consider  a  production  process  involving  microbian  growth 


□  Expanding  and  re-arranging 


—  =  -rs-DS  +  DSin 
dt  s 


where 


Dilution  rate 
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Mechanistic  model  for  fermentation  processes  (cont.) 


The  case  of  Baker’s  yeast  production 


□  We  feed  in 


O  Production  of 
e •  O  Biomass 


!  -I:-.'’  • : 

'-■rV.-. ' :  W-Tjy 


0  Ethanol 
O  Carbon  dioxide 


□  and  we  can  write  the  model 


X 

~rx 

X 

0 

0 

s 

A 

"rS 

s 

DSin 

0 

■7-  E 
dt 

=  “ip  " 

-D  E 

+  0 

-  0 

0 

~rO 

0 

OTR 

0 

c 

_rC 

C 

0 

CTR 

OTR 

=  Ke02 

a  [O  * 

-O] 

O*  >  O 

CTR 

_  TS 

XVeC02 

a  [C  * 

-C] 

C  >  C* 

***  OTR  and  CTR  can  be  estimated  on-line  from  mass  balances  to 
the  system 
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General  problem: 

cell  systems  are  extremely  complex! 


</  A  full  mathematical  description  of  cells  metabolism 
(cell  level  and  population  level)  is  too  complex 

</  Available  segregated  and  structured  cell  models  are 
at  the  moment  “out  of  range”  for  bioprocess 
optimization 

/  Hybrid  models: 

o  Disadvantage:  Hybrid  models  are  of 
considerable  complexity  =>  require 

sophisticated  software  tools  and  computation 
power 
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General  Dynamical  Model 
for  Fermentation  Processes 

§  =  r(^)-D^  +  F-Q(^) 
dt 

r©  =  ? 

r(4)  =  Kcp© 

r©  =  K  H(5)  p© 
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Advanced  Monitoring 

Software  sensors  /  State  estimation 

(Bastin  &  Dochain,  1990) 


=  F-Q 


4, 

dt 


=  K<p(ts,t)-DZ>  +  U 


2  state  partitions: 

(e  Rp)  and  £2  (e  Rn‘P) 


:  On-line  estimation  of  ^2,  given : 

r  y  (p  unknown 

/  p  measured  state  variables  (^) 

J  D,  U  (F,  Q)  measured  on-line 

v  J  meffieientS-of  Kk nnum - 

J 

^-=Ki<f-D£,x+Ul 

at 

^  =  K2<f-D^2+U2 
dt 


Make: 

Get: 


Z=  where  AKt  +  K2  =  0 


—  =  -DZ+  AUX  +AU2 
dt 


Got  rid  of  (p  !!! 
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Advanced  Monitoring 
Software  sensors  /  State  estimation  (cont.) 
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Model-based  state  observer 
for  Baker’s  Yeast  fermentation  - 1 


•  Estimation  of  OTR  e  CTR  by  mass  balances  to  the  gas 
phase 

•  Partial  kinetics  models 


Sin 

O 


X 

E_ 

S 


□  Sampling  rate  =  6  min 
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State  observers  and  PID  control  (simulation) 
•  Conditions 

-  E0=0.8g/l;S0=1.3g/l;X0=0.3g/l; 

-  V0=2  1;  F0=0  1/hr;  Sin=30  g/1; 

-  Kc=2.5  (l/hr)/(g/l);  ^=0.5  hr;  Td=0.05  hr 
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Model-based  state  observers  (experimental) 


•  Operating  conditions: 

•  Sin  =  100  g/1;  F  =  0.15  1/hr;  V0  =  2.5  1 
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Hybrid  modelling  of  fermentation  processes  - 1 
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Hybrid  modelling  of  fermentation  processes  -  II 
Monitoring  ANN  performance 


m 
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Hybrid  modelling  of  fermentation  processes  -  III 
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Hybrid  Modelling 

Case-Study  with  baker’s  yeast  production 

I  -  Structure 
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Hybrid  Modelling 

Case-Study  with  baker’s  yeast  production 
II  -  Neural-networks  employed 


Computer-Aided  Operation  of  Chemical  and  Biochemical  Processes 
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Biomass  concentration  (g/l) 
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Hybrid  Modelling 

Case-Study  with  baker’s  yeast  production 
IV  -  ANN  and  hybrid  model  training 


SFA/RO,  ISR/DEQ-FEUP,  Porto,  Portugal 


Mass  concentration  (g/l) 
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_  Hybrid  Modelling _ 

Case-Study  with  baker’s  yeast  production 
V  -  Pure  ANN  test 
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Hybrid  Modelling 

Case-Study  with  baker’s  yeast  production 


VI  -  Test:  pure  ANN  versus  HM 
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Hybrid  Modelling 

Case-Study  with  baker’s  yeast  production 
VII  -  Testing  of  hybrid  model 
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Case-study: 

Penicillin  production  process 


(substrate)  +  a  (precursor)  +  b  NH3  +  c  02  — 
d  (biomass)  +  e  (penicillin)  +  f  (C02)  +  g  (H20) 


✓  N  manipulatable  variables 


<E> 


✓ 

✓ 

✓ 

✓ 

✓ 

✓ 


Power  input  (Air  flow,  Agit.) 
Initial  medium  composition 
operatiombatch,  fed-batch,  pulse 

Input  flow  rates  of  several 
components 

Rate  of  heat  removal 
Fermentation  time 


►  J 


Process  performance  index  (J) 

o  Productivity 
o  Product  quality 
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Model-based  open-loop  control 


Trial-and-error 


o  Empirical  method:  intuition 
and  experience. 

o  Good  luck  is  an  essential 
condition  to  be  successful  in 
this  way. 

o  Slow  process  improvement 
o  More  experiments 


Model-based 


/  Identification: 

o  Models  Process 

/  Optimisation: 

o  Oopt  calculated 

analytically  or 
numerically 

max  (J(<t>,P))  ^0pt 
<1) 
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Automatic  control  of  ammonia  and  side 
chain  precursor  concentrations  in  a 
penicillin  production  process 


/  The  concentrations  of  ammonia  (CN)  and  side  chain 
precursor  (CPA)  in  the  broth  have  a  great  influence 
on  the  penicillin  productivity  of  a  given  strain. 

/  In  most  industries  this  control  is  performed 

manually  by  feeding  a  solution  of  ammonia  (FN)  and 
precursor  (FPA) 

/  The  measurements  of  CN  and  CpA  are  difficult  and 
expensive.  Measurements  are  made  off-line  with 
low  frequency. 
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Penicillin  biosynthesis 


Ammonia 


<X-aminoadipic  acid 


-  high  affinity  uptake  at 
low  concentrations 

-  low  affinity  uptake  at 


cysteia  +  valine  — . 

; . :  v 


too 

ACV  - 

1” 

isopcninUin  N 


high  concentrations  ■"'*** 

phenoxyacetic  add 

93  : 

Side  chain  precursor  j 
- — ►* . 

CC  -aminoadipLc  add 

Y) 

Id 


-  toxic  at  high  concentrations 

-  stimulates  the  synthesis  of 
penicillin  (about  5-fold  by 
penicillin  G) 


ACV 

IPN,  6-AFA  and  8-HPA 


jxnidHofc  V  acid 
and  p-OH-p^nidllin  V 


/Ammonia  and  side  chain  precursor  concentrations 
must  be  kept  constant  at  optimal  values  for  maximum 

penicillin  productivity! 
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Manual  empirical  control 


On-line  measurements:  OUR,  CPR 


OPERATOR 


PROCESS 


Set-points 


Cn,SP  CpA.SP 


Feeds 


Fpa 


Off-line  measurements  (  C  pa’  Cn,) 


Sampling 
time  At 


</  Expensive  off-line  measurements  (high  At) 

y  Classical  (PID)  control  not  feasible 
o  Manual  control 
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Manual  empirical  control 
(12  Fermentations) 


time(h) 

Figure  1.  Concentration  of  ammonia  for  12  fermentations  controlled  manually 


time(h) 

Figure  2.  Concentration  of  precursor  for  12  fermentations  controlled  manually 
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Inferential  control  system 


Se  tpoints 


C  C 

'~'N,SP  '-'PA.SP 


(Feeds 

- > 

fnfpa 


>■ 


On-line 

measur. 


t 


ESTIMATION 
MODEL  I 


Sampling 
time  At 


Indirect  measurements  (C  N,  CpA,  RN,  RPA) 


/  Estimation  (or  prediction)  model  for  the 

concentrations  of  ammonia  and  precursor  between  off-line 
measurements 


SFA/RO,  ISR/DEQ-FEUP,  Porto,  Portugal 


Computer-Aided  Operation  of  Chemical  and  Biochemical  Processes 


Macroscopic  mass  balance 
to  the  fermenter 


ASSUMPTION:  Well-mixed  bioreactors 
KINETIC  MODEL  =  ? 
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ANN-Kinetic  Model 


TRAINING  ALGORITHM 
Batch  training 

Sensitivities  method+BP+CGLS 
Cross-validation  (9/3) 


y  Feedforward  ANN  {6,7,2} 
y  65  ANN  parameters  ( dim(W)=65) 
y  9  Fermentations  for  training  (8137  experimental  points) 
y  3  Fermentations  for  validation  (2311  experimental  points) 

BP  -  B ackpropag ation ;  CGLS  -  Conjugate  Gradients  with  Line-Search 
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Training  algorithm 


Objective  function:  minimization  of  precursor  and  ammonia  estimation 
errors  according  to  a  batch  least-squares  criterion  (P  -  number  of  total 
measured  points): 


E= 


p 

p  E([  <x(CpAB(t)  -  CPA(t))  f  +  [  P(CNE(t)  -  CN(t))  ] 

V  1=1 


V- 


J 


The  objective  function  gradients  are  obtained  by  differentiating  the 
previous  equation  with  respect  to  the  ANN  parameters  vector  (W) 


f§ = -  ^^(o^CpaeW  -  CPA(t ))^p-  +  P(Q*(t)  -  C^t 
t=l 

aCPA/aW  and  SC^/SW  is  calculated  with  the  sensitivities  method 

dC 

C!!idW-L=  (dR»  I  F<°< )  SCn  SCpA  SRn 

dt  ydCN  w’  dW  dCPA  dW  dW 

Initial  conditions:  and  (SCp^SW^K) 

5RN/aCPA ,  and  5RN/5W  are  calculated  by  applying  the 

backpropagation  algorithm  to  the  ANN 
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Comparison  of  different  kinetic  models  (mean  absolute 
estimation  error)  for  12  fermentations 

AMMONIA  precursor 


1 .06  ACn  1.29  ACpa 


1.09  ACn  1.19  ACpa 


ca 

I 

<  0.53  ACn  °-80  acpa 


/  The  ANN  model  gives  best  results  for  the  ‘training  data 

set’ 

Problem: 

Neural  Networks  are  unreliable  in  extrapolation 
conditions! 


_  pa  jy  _y  U 

kpa  ““77  ~1PAfsns 
Aif  c» 


P  -l7b  R  -Y  R 

~ “  1N/SIXS 


Me 


H 

00 


X 

V 


/  =  — — CPR 
M, 

RN=Olfc+bl 

P-PA  =  +^2(0 


3 

o 
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Measuring  the  reliability  of  the  ANN  Kinetics: 

Clustering 


Fig.  1  -  Clustering  a  set  of  points  in  a  2- 
dimensional  data  space  D  ={Xi,  X2, ...} 


UP  0.875  -  0.100 
III  0.750  -  0.875 
0.625  -  0.750 
0  500  -  0.625 
0.375  -  0.500 
0.250  -  0.375 
0.125  -  0.250 
_ 0  -  0.125 


Set  of  discrete  points 
(measurements) 


Continuous  density  function 
(extrapolation  measure  -  EM) 


Fig.  2  -  Continuous  Probability 
distribution  in  a  2-dimensional 
space  (Clusters-representation) 
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Clustering  concept  - 1 


/  N  measured  input  vectors: 

{XJ={x1,x2,...,xN}  a{X} 


yf  M clusters  (multivariate  gaussian  distributions): 
(M<=  N/3), 

Cluster  i,  defined  by  - 

cj  -  vector  defining  the  ith  cluster  center 
o;  -  standard  deviation 


For  a  given  work  input  vector  x,  define 
Nj(c  i5ai5x)  =  e 


-llx-Cj 


2  Zrr  2 
/ai 


y  Extrapolation  measure  -  EM: 

EM(x)  =  max( Ni(x,ci,ai),N2(x,C2,cj2),-J  (x,cm>ctm)) 
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Clustering  concept  -  II 


■/  Clustering  algorithm:  vector  c,  for  xe  {X}  : 


£  =  f>in(j 


X 


7=1 


min(£) 

CUC2  >—?cC 


Algorithm:  k-mean  or  adaptive  k-mean  (Lloyd  (1957), 
MacQueen  (1967)) 


y  Standard  deviation: 

o  either  -  uniform  and  heuristically  defined 
♦  suggested  - 1/10  of  range 

o  or  -  algorithm  Global  First  Nearest- 

Neighbour 
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Hybrid 


network  estimation  model 


KINETICS 

ANN 


FUZZY 

WEIGHING 


t,  RS,CPR,  RQ 


Cpa>  CN 


t,  Rs>  CPR 


R. 


y  \  Rj 


t,  Rs,  CPR,  RQ  / 


CLUSTERS 


MASS  BALANCE 


dCJa 


dCjJdi 
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Fuzzy  weighting  node 

Table  II  -  Fuzzy  rules 

Rt:  IF  (EM  is  LOW)  THEN  (W^  is  LOW  andWFC  is  LOW  and W^  is  HIGH) 
R^:  IF  (EM  is  MED)  THEN  (W^  is  LOWanrfWFC  is  HIGH  and W^  is  LOW) 
R3:  IF  (EM  is  HIGH)  THEN  (W^  is  HIGH  and  WFC  is  LOW  andW^c »  LOW) 


— 


W ANN ^N, ANN  +  ^FC^N_JPC  ^MEC^NMEC 

W  ANN  ^FC  ^MEC 


R 


PA 


^ ANN  ^P A,  ANN  +  ^FC^PA,FC  +  ^MEC^PAJdEC 
W ANN  +  WFc  +  Wmec 
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Control  loop 


Indirect  measurements  (C^,  CpA,  RN,  RPA) 
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Results:  Precursor  automatic  control 
17  new  runs  in  automatic 


timefh) 

Fig.  1  -  Concentration  of  precursor  for  17  fermentations  controlled  automatically 


time(h) 

Fig.  2  -  Concentration  of  precursor  for  12  fermentations  controlled 
manually  (data  used  to  develop  the  control  system) 
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Results:  ammonia  automatic  control 
17  new  runs  in  automatic 


time(h) 

Fig.  3  -  Concentration  of  ammonia  for  17  fermentations  controlled  automatically 


time(h) 


Fig.  4  -  Concentration  of  ammonia  for  12  fermentations  controlled 
manually  (data  used  to  develop  the  control  system) 
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Comments  about  results 


/  Deviations  of  ammonia  concentration: 

O  For  automatic  operation,  the  probability  of 

concentration  being  outside  the  allowed  operating 
range  decreased  18%  relatively  to  manual 
operation 

</  Deviations  of  precursor  concentration: 

O  For  automatic  operation,  the  probability  of 

concentration  being  outside  the  allowed  operating 
range  decreased  22% 

✓  On-line  re-tuning  of  the  hybrid  method  should  be 
performed 
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Some  concluding  thoughts 


Today,  the  technological  conditions  are  here,  for  bringing  the 
theory  into  practice 

Model-based  and  adaptive  methodologies  and  AI  approaches 
will  play  a  major  role  in  process  operation 

«■  The  Human  factor  as  a  limiting  step  in  the  pace  of 
development 

O  cost  investment  sometimes  difficult  to  justify 
in  the  short-term 

O  lack  of  human  expertise  and  need  of  organizational  changes 
in  the  Companies  - 

□  the  pneumatic  systems  engineer  of  the  50 ’s 

□  the  electronics  engineer  of  the  70’ s, 

□  the  digital  systems  engineer  of  the  90 ’s, 

□  the  process  systems  engineer  of  the  00’s 
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